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METHOD FOR TIME SYNCHRONIZATION OF INFORMATION 
MEASURED BY MEANS OF IMAGING 

Field of the invention 

5 

The invention relates to a method according to the preamble of the 
appended claim 1 in the control of the quality or the condition of a fibre 
web on the basis of optical diagnostics by imaging, the control being ' 
applied in connection with the manufacturing or finishing process of a 
10 paper web. 

Background of the invention and prior art 

There is a constant aim to increase the web speeds utilized in the 

15 manufacturing and finishing processes of paper, paperboard and other 
corresponding web-like materials in order to improve the production 
rate. When the web speeds are increased, it is, however, necessary to 
monitor the function and state of the process in a more detailed man- 
ner than before in order to avoid an increase in web breaks that impair 

20 the production rate and in various defects in the quality of the fibre 
web. One method, which has been found to be very efficient in the real- 
time monitoring of a rapidly moving fibre web and its path, is to use 
optical diagnostic methods. Advantages of the optical methods include, 
for example, the possibility to take measurements of an object in a 

25 contactless manner and to take the measurements with a rapid time 
response. Several examples of applying optical methods in the manu- 
facturing and finishing processes of web-like materials are known from 
prior art. The present invention relates to optical imaging diagnostics 
for storing a spatially resolved visual image or other spatially resolved, 

30 optically measurable data about an object to be examined. In optical 
imaging systems, the detectors that are currently used are typically 
electrical matrix or line scan cameras, such as CCD cameras (charged 
coupled devices). 



35 US patent 5,821,990 discloses, on the principle level, a monitoring 
system in which measuring positions are arranged at different locations 
along the process to be monitored. In these measuring positions, the 



WO 03/081219 



PCT/FI03/00231 



2 

measuring devices used can be, for example, video cameras, and said 
monitoring system is suitable for use also in connection with the paper 
manufacturing process. 

5 One example of commercially available optical systems, which are par- 
ticularly suitable for the real-time monitoring of a fibre web and its path, 
are so-called web runnabiliby monitoring (WRM) systems. These sys- 
tems may comprise even several tens of camera units arranged to 
record an image of the fibre web and the machine means related to its 

10 processing at different points in the process. The primary function of 
WRM systems is to visually observe and analyze web breaks and the 
web runnability phenomena of the fibre web related therewith. The 
analysis is made by monitoring video sequences recorded in connec- 
tion with said events in different camera positions along the path. 

15 

The basic principle of the WRM system is shown in Fig. 1 . The camera 
units 1 to N may be placed, according to the need, at different points of 
the path of the fibre web, from the wet end of the paper machine all the 
way to the reeling up of the paper web. At present, single camera units 

20 used in the system are typically CCD cameras which operate on the 
visible wavelength range and which produce an analog video signal 10 
to be transmitted to computers used as image processing units 11, 12 
for image capturing, storage, digital image processing, and analysis. 
The results of the image analysis can be viewed via a user interface 13 

25 placed in a control room, and the visual image produced by the camera 
units 1 to N can also be viewed in its unprocessed form in real time, if 
necessary, via video monitors placed in the control room. 

Troubleshooting typically requires the examination of video samples 
30 recorded from different steps of the manufacturing process, i.e. 
recorded with the different camera units 1 to N. Video sequences cor- 
responding to the same point of the moving fibre web but recorded in 
different camera positions 1 to N at different times can be used to find 
out which step in the process is the origin of the cause for a defect. For 
35 example, if a break caused by an edge defect or a hole in the web is 
detected in the reel-up of the paper machine (camera unit N in Fig. 1), 
one must first determine if a web defect causing the break is already 
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visible in an earlier step in the manufacturing process, that is, for 
example in images stored by camera units N-1 , N-2. To determine 
this, the user of the monitoring system must find, from the video 
recordings of the camera units preceding the reel-up, the correspond- 
5 ing web section where the web defect that caused the break can be 
observed for the first time. 

Naturally, it will be obvious that in practice, problems in the runnability 
of the paper web must be solved as soon as possible to eliminate the 
10 cause of the disturbance as soon as possible and thereby to prevent a 
decrease in the production or an impairment of the quality of the prod- 
uct. 

In most modern WRM monitoring systems, the recordal and processing 
15 of video signals are performed in digital format. This makes it possible 
to synchronize image material recorded with different camera units in 
such a way that the system takes into account the delay in the time of 
travel of the web between the different camera positions. Because of a 
movement in the longitudinal direction,, i.e. machine direction of the 
20 web, the same point of the web is recorded at different times by cam- 
era units placed, for example, in the wire section, in the press section, 
in the drying section, and in the reel-up. The synchronization of image 
material taking into account the delay in the travel time makes it possi- 
ble to present image material corresponding to the same point simulta- 
25 neously in displays corresponding to different camera positions. This 
synchronization of images to be recorded in different camera positions 
is one of the most important features of the monitoring system, 
because it substantially facilitates the user's work and thereby acceler- 
ates the troubleshooting of runnability disorders in practice. 

30 

Finnish public patent application 990428 discusses the problems relat- 
ing to said synchronization and presents a solution to improve the syn- 
chronization. In the method presented in the application, an area of 
successive images at each camera position, limited in the longitudinal 
35 direction of the web, in which area the synchronization point is placed 
according to an approximate computation, is displayed to the user. In 
this way, the user's work is facilitated by limiting the number of images 
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to be examined, which the user must go through to find, for example, 
images representing a given edge defect in the web in the image mate- 
rial recorded in different camera positions. However, the method 
according to the patent application 990428 only makes an approximate 
5 synchronization of the image material possible, wherein the user must 
improve the synchronization manually by examining and comparing 
single images. 

In principle, the synchronization between different camera positions is 
simple, if the accurate speed of propagation of the web as well as the 
distance travelled by the web between the different camera positions 
are precisely known. Typically, in present systems, the displaying of 
exactly the same web point from different camera positions in a syn- 
chronized manner would require that the delay in the travel time 
between two camera positions is known at an accuracy of at least 
20 ms. When the imaging frequency is 50 or 60 images per second, 
said time corresponds substantially to the time difference between two 
successive images. In the future, imaging frequencies are expected to 
increase (to 100/120 images per second), which will further tighten said 
accuracy requirement. 

At present, the synchronization is based on inputting the distances 
between the camera positions (the distance travelled by the web 
between the different camera positions) to the camera monitoring sys- 
25 tern at the stage of introduction or configuration, and inputting the web 
speed as measurement data from the automation system controlling 
the paper machine. To improve the synchronization, the web speed is 
input separately from each operating group of the paper machine to the 
monitoring system, wherein also the differences in the operation 
30 between the different operating groups are taken into account. How- 
ever, even this procedure does not provide a sufficiently precise syn- 
chronization, because the web speed can normally not be measured at 
a sufficient precision and/or the exact length of the web between the 
different camera positions is not accurately known. 

35 

The measurement of the web speed according to prior art is based on 
measuring the rotation speed of rolls interacting with the web at the 



10 



15 



20 



WO 03/081219 



PCT/FI03/00231 



5 

centres of the rolls. Further, the peripheral speed of the rolls, corre- 
sponding to the web speed, is computed on the basis of information on 
the diameter of the rolls. However, the roll diameters are changed, for 
example, as a result of thermal expansion and pulping of the rolls, 
5 wherein the speed data determined by using the roll diameter is also 
changed accordingly. 

In practice, the synchronization between the camera units must be 
tuned to be more accurate in connection with the configuration and 

1 0 introduction of the camera system, by correction factors suitable for the 
result of computation based on the information on the distance and the 
web speed. The synchronization can be tuned, for example, by mark- 
ing the fibre web on the wire section of the paper machine with a spot 
of a colouring agent which can be detected in the image material to be 

15 recorded in the different camera positions. The tuning is now per- 
formed by the user who corrects the distance data between the differ- 
ent camera positions with suitable correction factors until the images 
are accurately synchronized with each other. However, this procedure 
will not lead permanently to a satisfactory final result, because it is only 

20 used to correct inaccuracies in the distance between the camera units 
(the distance travelled by the web). Thus, the tuned synchronization 
will only function correctly in use situations corresponding precisely to 
the tuning conditions. However, if changes take place in, for example, 
the roll diameters, the operating differences between the operating 

25 groups, the speed of the paper machine, or other corresponding factors 
effective on the travel time delay, the accuracy of the synchronization is 
decreased. 

Basic principle and most important advantages o f the invention 

30 

It is a primary aim of the present invention to synchronize information, 
measured by means of imaging in different measuring positions at dif- 
ferent steps of a process, with each other in time, in the control of the 
quality or the condition of a fibre web and/or movable means relating to 
35 its processing, on the basis of optical imaging diagnostics. 
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To attain this purpose, the method according to the invention is primar- 
ily characterized in what will be presented in the characterizing part of 
the independent claim 1 . 

5 The other, dependent claims will present some preferred embodiments 
of the invention. 

The essential basic idea of the invention is that information on the fibre 
web and/or a moving means relating to its processing (for example, 

10 wires, felts, rolls, reels, or the like), measured by means of imaging at 
different measuring positions, is scanned to find out single recogniz- 
able features relating to specific local areas of the fibre web by means 
of digital pattern recognition. Such a recognizable local feature may be, 
for example, an edge defect or a hole occurring in the fibre web, or a 

15 "tail" of the fibre web running through the paper machine in connection 
with a break of the fibre web. According to the invention, the same sin- 
gle feature of the fibre web is detected from information recorded at 
different measuring positions, to find out the exact travel time delay 
between the different measuring positions, on the basis of which the 

20 synchronization of the measuring positions can now be performed 
accurately. 

Consequently, the method of the invention makes it possible to tune 
the automatic synchronization during the use of the monitoring system 
25 to correspond to varying process conditions, such as changes in the 
speed of the fibre web between different parts of the paper machine. 

The invention is particularly suitable for use in monitoring systems 
recording visual image material, such as the WRM system, but the 
30 invention is also suitable for use in connection with other imaging 
measuring systems, in which information on a fibre web and/or a mov- 
ing means relating to its processing is stored in an optical and location- 
resolved manner by imaging measuring devices placed at different 
locations in the process. 

35 

The invention makes it considerably faster and easier to recognize the 
cause of disturbances in the process, because the monitoring system 
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can now automatically synchronize the information measured at differ- 
ent measuring positions. Thus, the user does not need to go through 
the measured information manually when looking, for example, for 
images representing a given edge defect in the web from the image 

5 material recorded at different camera positions. Furthermore, the 
invention makes it possible to automatically analyze the measuring 
results by computer significantly more efficiently than before, as well as 
to compile statistical material relating to disturbance situations in a 
more reliable manner than before. By means of the invention, use can 

10 be made of all the benefits of the higher imaging frequencies available 
in the future, avoiding, for example, the unnecessary storing of image 
material in the memory of the system, because the storing can be lim- 
ited to areas defined in more detail by means of the invention. 

15 The following, more detailed description of the invention with examples 
will more clearly illustrate, for anyone skilled in the art, preferred 
embodiments of the invention as well as advantages to be achieved 
with the invention in relation to background art. 

20 Brief description of the drawings 

In the following, the invention will be described in more detail with 
reference to the appended drawings, in which 

25 Fig. 1 shows the basic principle of the WRM system according to 
prior art, 

Fig. 2 shows, in a principle view, the synchronization between 
different camera units according to prior art, and 

30 

Fig. 3 illustrates, in a principle view, an automatic synchronization 
method based on pattern recognition according to the 
invention. 
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Detailed description of the invention 

Figure 1 has already been discussed in connection with the description 
of prior art. 

5 

Figure 2 further shows, in a principle view, the approximate synchroni- 
zation method of image material according to prior art, as described, 
for example, in Finnish patent application 990428. 

10 The functions shown in Fig. 2 are typically performed in computers or 
corresponding devices used as image processing units 11, 12 in Fig. 1. 
For the synchronization, information about the speed 21 of the fibre 
web as well as information about the distances 22 between the camera 
units used in the monitoring system is input in the synchronization 

15 system 20. 

When the user or the monitoring systems selects, from the image 
material of a camera N, an interesting image X, which image X shows, 
for example, a tear in the fibre web, the synchronization system 20 can 

20 use the event time data 23 relating to the image X to determine, by 
simple calculations and by using the speed and distance data 21, 22, 
the image sequences W corresponding to the same point of the web in 
the image information recorded by other, preceding cameras N-1 , N-2, 
N-3 in the travel direction of the web. According to prior art, by select- 

25 ing the temporal length of the image sequence W to be sufficiently 
long, one can now be sure that the section of the web corresponding to 
the image X from the camera N can be found in the image material 
recorded by the different cameras N-1, N-2, N-3 within said image 
sequence W. Because of the earlier mentioned inaccuracies related to 

30 the determination of the travel time delay, however, the accuracy of the 
above-described approximate synchronization is not sufficient to indi- 
cate the single images corresponding to the same point in the web 
recorded by different cameras, that is, to set the length of the image 
sequence W to correspond to substantially one image. 

35 

Figure 3 illustrates, in a principle view, an automatic synchronization 
method based on pattern recognition according to the invention. 
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In Fig. 3, image X is shown uppermost among the successive images 
recorded by a camera N, in which image X a recognizable feature 30 is 
detected in the fibre web. In this example case, the feature 30 may be, 
5 for example, a defect at the edge of the web, such as an incipient tear 
of the web. According to prior art, from the image material of the cam- 
eras N1, N-2, N-3, an image sequence W is determined by means of 
approximate synchronization, which, in the example case, comprises a 
sequence of five images for each camera. 

10 

According to the present invention, the means of digital image proc- 
essing and pattern recognition are used to analyze the images of the 
cameras N, N-2, N-3 in the range of the image sequence W to look for 
the same feature 30 in the image material from different cameras, 

1 5 wherein it is possible to determine the exact travel time delays between 
the different measuring positions to improve the synchronization 
between the different measuring positions. In Fig. 3, the tuning by the 
approximate synchronization by the method of the invention is illus- 
trated by means of time differences T N ^, T N . 2 and T N . 3 . According to 

20 the invention, said time differences are thus determined by means of 
digital image processing and pattern recognition of image material from 
the different cameras 1 to N without specific measures required of the 
user. 

25 When said time differences TV,, T N - 2 and T N ^ are input further in the 
synchronization system 20, the approximate synchronization based on 
the speed and distance data 21, 22 can now be made more accurate 
so that the length W of the image sequence can be set optimally to cor- 
respond to one image. 

30 

According to the invention, the search for the feature 30 corresponding 
to the same point in the fibre web in the image material from different 
camera units is made by using digital image processing and pattern 
recognition. By using digital image processing methods known as such, 
35 an interesting feature 30 of the fibre web can be allocated pattern rec- 
ognition parameters which represent a feature in the image X, for 
example the size and shape of the feature. These parameters are util- 
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ized to find the feature in the image material produced by the other 
camera units. The image material from different camera units can also 
be processed by image processing methods known as such, for exam- 
ple, by removing so-called background which remains substantially 

5 unchanged in the images, wherein abnormal features deviating from 
said background are emphasized. Furthermore, the images can be 
edited for feature recognition, for example, with respect to the contrast 
and the scale of grey tones or colours. In the image processing, it is 
possible to use known filtering, sharpening, size scaling or other corre- 

10 sponding methods of image processing. The invention is in no way 
restricted with respect to image processing and pattern recognition 
methods used for recognizing features. 

For example, a hole or another defect occurring in the fibre web may 
1 5 change its size and shape when passing through the different sections 
in the paper machine; therefore, the methods and the parameters used 
for pattern identification must be selected suitably by not setting too 
hard criteria for the recognition. To avoid false recognitions, it is possi- 
ble to use approximate synchronization of prior art to determine the 
20 length of the approximate image sequence W in the different imaging 
positions, in which range the same feature 30 of the fibre web is to be 
recognized in the image material produced by different camera units. It 
is obvious that said length of the image sequence W can be selected, 
depending on the accuracy of the approximate synchronization, to be 
25 suitable in each case, and further, to be of different size at different 
camera units, if necessary. 

The method according to the invention is adaptive in its nature; that is, 
the synchronization will automatically adapt to changes in the process, 
30 which change the travel time delay between the different camera units. 
In a situation in which said travel time delays remain substantially con- 
stant for a longer time, the method of the invention can be used con- 
tinuously to improve the absolute precision of the synchronization more 
and more. 

35 

The tuning of the synchronization according to the invention can be 
performed either for all or for some of the camera units or measuring 
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units used in the measuring system. The method can be applied auto- 
matically and substantially continuously without measures required of 
the user. It is also possible that the tuning of the synchronization 
according to the invention is only performed upon request of the user, 

5 on the basis of image information recorded in connection with a web 
break or another corresponding phenomenon. Furthermore, automatic 
synchronization can also be supported by intentionally causing a 
clearly distinguishable local feature in the fibre web. At the initial end of 
the paper machine, the fibre web can be marked, for example, with a 

10 spot of a colouring agent. The image material relating to this is 
recorded, and the automatic recognition of said stored image material 
and tuning of the synchronization based on it is started according to the 
invention. 

15 The single features to be found in the image material and relating to 
specific locations in the fibre web may be, for example, local defects, 
such as edge defects or holes, occurring in the fibre web. For example, 
local defects of a coating, which can be detected optically by means of 
imaging measurements, are also suitable for the purpose. In connec- 

20 tion with a break of the fibre web, the "tail" of the fibre web travelling 
through the paper machine can also be used to improve the synchroni- 
zation. 

Particularly in situations, in which the defect to be searched in the 
25 images is small in relation to the whole observation area of the image, 
it is possible to use, if necessary, the so-called ROI principle (ROI = 
Region of Interest) in the analyses. Thus, instead of examining the 
whole image area of the camera units, the examination is only focused 
on a part of the image or observation area, for example on a given 
30 width of the web in the transverse direction. This is illustrated with 
observation areas ROI limited in the transverse direction of the web, 
marked in Fig. 3. When applying the ROI principle, the analyzing of the 
images becomes faster and also more reliable. In digital image proc- 
essing, the speed of the image processing is significantly affected by 
35 the size of the images to be processed. When utilizing the ROI princi- 
ple, the image sizes to be analyzed become significantly smaller in 
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their number of pixels, wherein it is also possible to use pattern recog- 
nition algorithms which are more complex and require more computing. 

The invention is not limited solely to the analysis of information on the 
5 fibre web itself, recorded by means of imaging, but the method can 
also be used to look for a feature (for example based on marking) cor- 
responding to a given area of the fibre web in information on, for 
example in wires, felts, rolls, or reels, recorded by means of imaging. 
When the peripheral speed of the moving means involved in the proc- 
10 essing of said fibre web, in relation to the travel speed of the fibre web, 
is known, it is also possible to use recorded information on them for 
determining the travel time delays of the fibre web between different 
measuring positions. 

15 Thanks to the invention, by means of precise synchronization in the 
longitudinal direction of the fibre web, it is possible, in practice, to rec- 
ognize the original cause of a web break or a quality defect of the fibre 
web at a higher certainty. When the defect is detected, for example, by 
a given camera unit at the final end of the paper machine, the defect 

20 can be followed backwards in the travel direction of the fibre web in the 
paper machine. Thanks to the invention, the search can be limited to 
as small a number of single images as possible in the image material 
recorded by the preceding camera units. This makes it possible to find 
defects, which are smaller than before and thereby more difficult to 

25 detect, even at the initial end of the process where they have not yet 
developed to be well discernible. 

After the cause of a web break or a quality defect in the fibre web has 
been recognized, the cause of said defect can be compiled in statistics. 
30 The statistics can be used for the evaluation of the condition of different 
machine means of the paper machine, such as, for example, drying 
felts. If the same machine means turns out to be continually the cause 
of a defect, it is known that said machine means requires either main- 
tenance or replacement. 

35 

Thanks to the improved synchronization by means of the invention, the 
number of images needed for further examination later can be reduced 
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(the length of the image sequence W can be reduced). Due to the 
smaller quantity of information to be stored in digital format, the images 
can be stored either in full, without compression of the images, or by 
using a lower degree of compression. Thus, the image material to be 
5 stored remains of high quality, which makes it possible to use more 
precise analysis methods. 

Using the method of the invention, it is possible to better detect and 
analyze such quick phenomena which cannot be appropriately 

10 detected by subjective analyses of prior art and primarily by the user, of 
image material or other corresponding location-specific measurement 
data. Thanks to the invention, the more effective statistical utilization of 
the measurement results helps to design maintenance and repair 
measures of production equipment better than before. In this way, 

15 unforeseen and extra stoppages are avoided. 

By various combinations of the methods and device structures 
presented in connection with the different embodiments of the invention 
above, it is possible to provide various embodiments of the invention 
20 which comply with the spirit of the invention. Therefore, the above- 
presented examples must not be interpreted to restrict the invention, 
but the embodiments of the invention can be freely varied within the 
scope of the inventive features presented in the claims hereinbelow. 

25 Although the invention has been described above primarily in connec- 
tion with camera systems recording a visual image in the visible wave- 
length range, the invention is also suitable for the use of other kinds of 
optical measuring systems, in which location-specific information is 
collected of an object by means of imaging in the longitudinal direction 

30 of the fibre web. The invention is thus suitable for use, for example, in 
connection with thermal cameras operating in the infrared range, or 
also in connection with other camera detectors operating in the non- 
visible wavelength ranges. Furthermore, the invention is suitable for 
use also in connection with other measuring devices based on imaging 

35 and, for example, spectral resolution. 
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The significance of the benefits obtained with the invention will be 
increased further in the future, when higher and higher imaging and 
measuring frequencies are taken into use. 



